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A METHOD AND APPARATUS TO MAXIMIZE BANDWIDTH 



AVAILABILITY TO USB DEVICES 



BACKGROUND OF THE INVENTION 



Field of the Invention 



[0001] 



This invention relates to universal serial bus (USB) use, and more 



particularly to a method and apparatus of balancing available USB bandwidth 
5 for USB devices. 



(PC) systems, there exist USB ports for connecting various USB devices. Some 
of these USB devices are frequently used by PC users. For example, these USB 

10 devices may be printers, compact disk read-only-memory (CD-ROM) drives, 
CD-ROM Writer (CDRW) drives, digital versatile disk (DVD) drives, cameras, 
pointing devices (e.g., computer mouse), keyboards, joy-sticks, hard-drives, 
speakers, etc. Some of these devices use more of the available USB bandwidth 
than others. For example, a USB CDRW is a high bandwidth device, while 

15 human interface devices (HID), such as computer mice, keyboards and 
joysticks, are low bandwidth devices. 

[0003] Different standards of USB technology have different 

bandwidths. For example, Universal Serial Bus Specification, revision 1.1, 
September 23, 1998 (USB 1.1) devices are capable of operating at 12 

20 Mbits/second (Mbps), and Universal Serial Bus Specification, revision 2.0, 

April 27, 2000 (USB 2.0; also known as high-speed USB) devices are capable of 
operating at 480 Mbps. Many users of PCs may not understand how to plug in 
USB devices into the PCs such that two high-bandwidth devices are not 
sharing the same root hub. When different devices share the same root hub, 

25 the devices also must share/split the bandwidth of the USB. 

[0004] For example, if a user wishes to use a USB CDRW and a USB 

hard drive, (both are high bandwidth devices) and the user plugs both devices 
into the USB PC ports that share the same root hub, the hard drive and CDRW, 
will operate at approximately half of their associated maximum speed 

30 capability when simultaneously used. Therefore, assuming both devices are 
USB 1.1 devices, the throughput is divided in half due to a shared root hub. 



[0002] 



Description of the Related Art 

In many of todays processing systems, such as personal computer 
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Thus, the devices may only operate at a rate of 6 Mbps when used 
simultaneously, instead of the maximum rate of 12 Mbps. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0005] The invention is illustrated by way of example and not by way of 

5 limitation in the figures of the accompanying drawings in which like references 
indicate similar elements. It should be noted that references to "an" or "one" 
embodiment in this disclosure are not necessarily to the same embodiment, 
and such references mean at least one. 

[0006] Figure 1 illustrates a system having a universal serial bus (USB) 

10 host controller, USB bus, and USB root hubs. 

[0007] Figure 2 illustrates a USB host controller coupled with 

input/output (I/O) connectors for USB devices. 

[0008] Figure 3 illustrates a system coupled with an embodiment of the 

invention having a USB load balancing circuit. 
15 [0009] Figure 4 illustrates an embodiment of the invention coupled 

between a USB host controller and I/O connectors for USB devices. 

[00010] Figure 5 illustrates an embodiment of the invention. 

[00011] Figure 6 illustrates a block diagram of a process of an 

embodiment of the invention for using a USB class based balancing policy. 
20 [00012] Figure 7 illustrates a block diagram of a process of an 

embodiment of the invention using a USB use and bandwidth consumption 

based policy. 

DETAILED DESCRIPTION OF THE INVENTION 

[00013] The invention generally relates to an apparatus and method to 

25 best use the available bandwidth of universal serial bus (USB) devices. 

Referring to the figures, exemplary embodiments of the invention will now be 

described. The exemplary embodiments are provided to illustrate the 

invention and should not be construed as limiting the scope of the invention. 

[00014] Figure 1 illustrates a typical system comprising central processor 

30 unit (CPU) 120, memory 110, north bridge 130, hub link 140, and south bridge 

135. Typically, the chief responsibility of north bridge 130 is the CPU interface. 

In addition, north bridge 130 may also have controllers for an accelerated 
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graphics port (AGP), memory 110, and hub link 140, among others. South 
bridge 135 is typically responsible for a hard drive controller, USB host 
controller 150, an input/ output (1/ O) controller, and any integrated sound 
devices, amongst others. 



controller 150 having root hubs 151, 152 and 153. Root hub 151 may be directly 
coupled to USB devices 174 and 175 via USB bus 158 and 159, respectively. 
Root hub 152 may be directly coupled to USB devices 172 and 173 via USB 
buses 156 and 157, respectively. Root hub 153 may be directly coupled to USB 
devices 170 and 171 via USB buses 154 and 155, respectively. 
[00016] Figure 2 illustrates USB host controller 150 coupled to USB ports 

225-230. USB devices 170-175 can be coupled to USB ports 225-230. It can be 
seen from Figure 2 that two devices can be connected to USB ports coupled to 
the same USB root hub. If two high bandwidth devices are connected to the 
same hub, the two devices may only operate at half the intended rate. For 
example, if a high bandwidth device is connected to USB port 225, and another 
high bandwidth device is connected to USB port 226, then both devices will be 
connected to USB root hub 151. If USB root hub 151 is using USB 1.1, then the 
maximum bandwidth is 12 Mbps. If USB root hub 151 is using USB 2.0, then 
the maximum bandwidth is 480 Mbps. Therefore, both devices connected to 
USB root hub 151 will share the available bandwidth. 

[00017] If a user is not sophisticated in USB technology, the user would 

not know why the two devices seem to be running at a slower pace, than if 
separately connected to different root hubs. If the user has six USB devices that 
she wishes to connect to USB ports 225-230, the user would have to know each 
devices capabilities and be able to determine the most efficient way to connect 
each device to each port. This is compounded if both USB 1.1 and 2.0 
technology is included in the same system. For an average PC user this can be 
frustrating and time consuming. 

[00018] Figure 3 illustrates a system having an embodiment of the 

invention. System 300 comprises CPU 120, memorv/flO, north bridge 130, hub 
link 140, and south bridge 135. South bridge 135^ comprised of USB host 
controller 150 having root hubs 151, 152 and 183. In one embodiment of the 
invention, USB load balancing circuit 310 is/aisposed between USB host 



[00015] 



South bridge 135, as illustrated, is comprised of USB host 
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# 




mses 154-159 via USB load balancing 



controller 150 and root hubs 151-153. Ropt hubs 151-153 may be coupled to 
USB devices 170-175 
IFcui 
[00019] 



Figure 4 illustrates an embodiment of the invention having USB 
5 load balancing circuit 310 coupled with USB ports 225-230. By using USB load 
balancing circuit 310, USB ports 225-230 are variably connectable to USB root 
hubs 151-153. When a device is connected to a USB bus, the device is 
enumerated by the USB subsystem, i.e. a unique device number (e.g., 1-127). 
The unique number is assigned to the device, then the device descriptor is read 
10 by the USB host controller. The USB device descriptor is a data structure that 
contains information about the device and the device's properties. Each USB 
device typically only has one device descriptor. 

[00020] Other descriptors exist such as the configuration descriptor, the 

interface descriptor, the endpoint descriptor and optional string descriptors. 
15 The device descriptor and interface descriptor each contains fields related to 
device classification. These fields contain the class of the device, sub-class of 
the device and protocol of the device. These fields are used by a host system to 
associate a device or interface to a device driver. Some of the device classes are 
as follows: Display, Communication, Audio, Mass Storage and Human 
Interface. 

00021] Figure 5 ill us li ales an embodiment of the invention having USB — " 

load balancing circuit 310 illustrated in further detajj^fffone embodiment, USB 
load balancing circuit 310 comprises switchipg^roups 520, 530, 540, 550, 560 
and 570. Switching groups 520, 530^40^550, 560 and 570 are controlled by 
25 registers (not shown) in one erpfetJaiment of the invention. The registers are 
software /BIOS controllable in one embodiment of the invention. USB signals 
on USB buses \5As¥59 are dynamically routed to particular USB ports based on 
-states or nfgis ? teis. * 

[0022] -fe-erte-e mbudimeiil uf t he - invent lion, the regi s t e r G tate s-are — 

etained even when alternating current (AC?) power is removed from the 
device, such as a PC. In one embodiment of the invention the switching of 
each port has a unique default state iyarv event when controlling registers do 
not yet have information. In one embodiment of the invention, a software 
driver or software utility can be ^sed to program the registers used by load 





5 



42390P11079 Express Mail N^^EL651820655US 

balancing circuit 310. One should note that/any number of processes and/or 
algorithms can be used to program the registers used by load balancing circuit 
310. In another embodiment of the invention, the Basic Input/Output System 
(BIOS) of the PC or device system i^used to program the registers. A BIOS is 
5 the program which starts up a computer device and communicates between 
devices in the computer system (such as a hard drive and graphics card) and 
the operating system. BIOS/s normally stored in an erasable programmable 
j^a4-<?miy-memS^ 

[00023] In one embodiment of the invention, a USB load balancing policy 

10 based on USB device classes is used to allow USB devices to maximize 

available USB bus bandwidth. Particular classes of USB devices tend to require 
the same amount of USB bus bandwidth. In one embodiment of the invention, 
classes of high bandwidth devices are paired with classes of low bandwidth 
devices to maximize each device's specific bandwidth requirement. The USB 
15 device descriptors are read to retrieve the specific class of the device. Based on 
the USB device classes, specific USB device classes are separated from being 
connected to USB root hubs with other specific classes. 

[00024] For example, in one embodiment of the invention Mass Storage 

class devices (e.g., hard drives) are separated so they do not run on the same 
20 root hub. Other device classes, for example HID class, which uses minimal 

bandwidth, can be paired to run on the same root hub as a Mass Storage device 
class device. In another embodiment, classes of low bandwidth devices are 
allowed to be paired together. 

[00025] Figure 6 illustrates a block diagram of a process of an 

25 embodiment of the invention for using a USB class load balancing policy. 

Process 600 in Figure 6 starts with block 610, which determines whether a new 
USB device is attached to a USB port. If a new USB device is attached to a USB 
port, than process 600 continues with block 620. If there are not new USB 
devices attached to a USB port (other than those already attached), then 
30 process 600 continues with block 610. Block 620 reads an attached device's 
USB descriptor from the USB bus. After the USB descriptor has been read, 
block 630 determines the USB class type from the read descriptor. Block 640 
determines the allocation of USB root hubs based on the USB class type. Block 
640 also keeps track of which USB devices are attached to which USB root 
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hubs. For example, in one embodiment of the invention a table is kept with 
USB class type, USB root hub assigned and USB device. 
^^00026] — ^-^^Jp^nc embodiment, logic - determines wh i chTJ8B de ?vlCH5- aT0 — 
} / allowed to connect to the same USB root hub and whid^XJSB devices are not 
ET allowed to connect to the same USB hub. Then the available USB root hubs are 
allocated USB devices according to the allowable/connections. After the 
allocation of USB devices is determined, bloplu650 writes information to 
registers used by load balancing circuit 310. The registers control switching of 
USB root hubs to available USB port^/After the switching occurs, process 600 
10 determines if any additional USB>2evices have been attached to a USB port. In 
one embodiment of the invention process 600 dynamically switches USB 
devices between USB rooffiubs before the device is placed in use so as to avoid 
interrupting processe^such as writing to a USB hard drive, writing to a CDRW, 
^printing a documeiru > etc — ■ 
15 [00027] In one embodiment of the invention, a use and bandwidth 

consumption based policy is used to allow USB devices to maximize available 
USB bus bandwidth. In one embodiment of the invention the use and 
bandwidth consumption based policy uses a background driver to monitor the 
amount of use and bandwidth consumption of each USB device connected to 
20 the system. Information gathered from the monitoring of the use and 

bandwidth consumption of each USB device connected to the system is then 
used to determine how each device should be connected to the various USB 
ports to optimize the available USB bandwidth. 

[00028] For example, suppose a user has a USB hard drive, a USB 

25 scanner, a USB mouse and a USB printer connected to her PC at various 

input/output (I/O) ports. The background driver monitoring the use and 
bandwidth consumption of each device returns information that the USB 
scanner is not being used at the same time as the USB printer, that the USB 
mouse only requires minimum bandwidth, and the USB hard drive is 
30 frequently used. The USB ports are then balanced accordingly. Therefore, the 
USB hard drive is paired with the USB mouse on a particular USB root hub, 
and the USB scanner is paired with the USB printer on another USB root hub. 
Thus, the user does not have to determine before hand, or switch the devices 
randomly to maximize the available USB bandwidth per USB root hub. 
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[00029] In one embodiment, USB load balancing circuit 310 does not 

switch the USB port device allocations until USB devices have completed 
operations to prevent switching in the middle of USB device use. In another 
embodiment, the information retrieved from background monitoring is used 
5 upon the next system startup to prevent interruptions by switching devices 
that are currently in use. 

[00030] Figure 7 illustrates a block diagram of a process of an 

embodiment of the invention for using a USB use and bandwidth consumption 
based policy. Process 700 in Figure 7 starts with block 710, which determines 

10 whether a new USB device is attached to a USB port. If a new USB device is 
attached to a USB port, than process 700 continues with block 720. If there are 
not new USB devices attached to a USB port (other than those already 
attached), then process 700 continues with block 710. Block 720 reads an 
attached device's USB descriptor from the USB bus. After the USB descriptor 

15 has been read, block 730 monitors each USB device connected to a USB port for 
use and bandwidth consumption. Process 700 continues with block 740 
determining allocation of USB root hubs based on use and USB bandwidth 
consumption. 

[00031] In one embodiment of the invention block 740 keeps a table of 

20 which USB devices are used or not used with other USB devices, and how 

much of the available bandwidth each device uses. In one embodiment, block 
740 keeps a running average of USB bandwidth consumption per each USB 
device. Block 740 makes use of bandwidth consumption and USB device usage 
information to allocate USB devices to available USB root hubs to maximize the 

25 available USB bus bandwidth for the attached USB devices, 
w ^^+00032] In ono pmbnrlimpnfr AHh f Hnvnnti^n rpr™ nr >rr 700 r^ntiniiP c with — ■ 

r\j/ block 750, which determines whether the USB devices attached are currently in 
^ use. If the attached USB devices are currently^ use, process 700 continues 

with block 710. If the USB devices that are m be reallocated are not in use, then 

30 process 700 continues with block 760. Bk^ck 760 writes information to registers 
used by USB load balancing circuit 31£L Process 700 then continues with block 
770. Block 770 switches the USB potts to the allocated USB root hub based on 
device use and bandwidth consumption. 
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00033] Tn on > i i nln ii lii I i i f I hr invention prorp.^ 7p fl dynamically 

switches available USB ports when the USB devices toj^e switched are not 
currently being used. This is to prevent situajiertgwhen interruption of a 
device would cause the loss of datap^5e inconvenient (e.g., printing 
documents, writing to hard^irlves, etc.). In another embodiment, process 700 
writes the inforni^krfito registers used by USB load balancing circuit 310 to be 
used upop-i^start of the computer if the same devices are attached to USB 

[00034] With the use of USB load balancing circuit 310, and embodiments 

10 of the invention previously described, users of USB systems do not have to 

manually switch USB devices to maximize the available bandwidth associated 
with a USB root hub. Also, embodiments of the invention assists users that do 
not understand USB bandwidth availability or device consumption. Even if 
users do understand USB root hub bandwidths and device consumption, 

15 embodiments of the invention saves time and prevents user frustration by 
allocating USB devices /root hubs to maximize the available bandwidth to a 
plurality of USB devices. It should be noted that while examples may have 
mentioned USB 1.1 and USB 2.0, that the embodiments of the invention are 
applicable to future USB developments also. 

20 [00035] The above embodiments can also be stored on a device or 

medium and read by a machine to perform instructions. The device or 
medium may include a solid state memory device and /or a rotating magnetic 
or optical disk. The device or medium may be distributed when partitions of 
instructions have been separated into different machines, such as across an 

25 interconnection of computers. 

[00036] While certain exemplary embodiments have been described and 

shown in the accompanying drawings, it is to be understood that such 
embodiments are merely illustrative of and not restrictive on the broad 
invention, and that this invention not be limited to the specific constructions 

30 and arrangements shown and described, since various other modifications may 
occur to those ordinarily skilled in the art. 
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